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Abstract —Error probabilities of random codes for memoryless 
channels are considered in this papeiQ In the area of communi¬ 
cation systems, admissible error probability is very small and it 
is sometimes more important to discuss the relative gap between 
the achievable error probability and its bound than to discuss 
the absolute gap. Scarlett et al. derived a good upper bound 
of a random coding union bound based on the technique of 
saddlepoint approximation but it is not proved that the relative 
gap of their bound converges to zero. This paper derives a new 
bound on the achievable error probability in this viewpoint for 
a class of memoryless channels. The derived bound is strictly 
smaller than that by Scarlett et al. and its relative gap with the 
random coding error probability (not a union bound) vanishes 
as the block length increases for a fixed coding rate. 

Keywords—channel coding, random coding, error exponent, 
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I. Introduction 

It is one of the most important task of information theory to 
clarify the achievable performance of channel codes under fi¬ 
nite block length. For this purpose Polyanskiy ||2l and Hayashi 
El considered the achievable coding rate under a fixed error 
probability and a block length. They revealed that the next 
term to the channel capacity is 0(l/v^) for the block length 
n and expressed by a percentile of a normal distribution. 

The essential point for derivation of such a bound is to 
evaluate error probabilities of channel codes with an accurate 
form. For this evaluation an asymptotic expansion of sums 
of random variables is used in ||2l. On the other hand, the 
admissible error probability in communication systems is very 
small, say, 10“ for example. In such cases it is sometimes 
more important to consider the relative gap between the 
achievable error probability and its bound than the absolute 
gap. Nevertheless, an approximation of a tail probability ob¬ 
tained by the asymptotic expansion sometimes results in a large 
relative gap and it is known that the technique of saddlepoint 
approximation and the (higher-order) large deviation principle 
is a more powerful tool rather than the asymptotic expansion 

E). 

Bounds of the error probability of random codes with a 
small relative gap have been researched extensively although 
most of them treat a fixed rate R whereas El El consider 
varying rate for the fixed error probability. Gallager Q derived 
an upper bound called a random coding union bound on 
the rate of exponential decay of the random coding error 

'This paper is the full version of (T) in ISIT2015 with some corrections 
and refinements. 


probability for fixed rate R. It is proved that this exponent 
of the random code is tight for both rates below the critical 
rate El and above the critical rate El. 

There have also been many researches on tight bounds of 
the random coding error probability with vanishing or constant 
relative error for a fixed rate R. Dobrushin Q derived a bound 
of the random coding error probability for symmetric channels 
in the strong sense that each row and the column of the 
transition probability matrix are permutations of the others. 
The relative error of this bound is asymptotically bounded by 
a constant. In particular, it vanishes in the case that the channel 
satisfies a nonlattice condition. 

For general class of discrete memoryless channels, Gallager 
il derived a bound with a vanishing relative error for the 
rate below the critical rate based on the technique of exact 
asymptotics for i.i.d. random variables, and Altug and Wagner 
13 corrected his result for singular channels. For general 
(possibly variable) rate R, Scarlett et al. ifTOll derived a simple 
upper bound (we write this as Ps{n)) of a random coding 
union bound Previn) based on the technique of saddlepoint 
approximation and showed that PRCu(ti) < (1 + o(l))Ps(n) 
for nonsingular finite-alphabet discrete memoryless channels 
M- However, This bound does not assure Prcu(^) = (1 + 
o(l))Ps(n). 

In this paper we consider the error probability Prc 
of random coding for a fixed but arbitrary rate R below 
the capacity. We derive a new bound Pnew which satisfies 
Pnew(n-) = (1 + o(l))PRc(n.) for (possibly infinite-alphabet 
or nondiscrete) nonsingular memoryless channels such that 
random variables associated with the channels satisfy a condi¬ 
tion called a strongly nonlattice condition. The derived bound 
matches that by Gallager El for the rate below the critical 
ratfl 

The essential point to derive the new bound is that we 
optimize the parameter depending on the sent and the received 
sequences to bound the error probability. This fact 

contrasts to discussion in nni and the classic random coding 
error exponent where the parameter is first fixed and optimized 
after the expectation over {X,Y) is taken. We confirm that 
this difference actually affects the derived bound and by this 
difference we can assure that the bound also becomes a lower 
bound of the probability with a vanishing relative error. 


^In the ISIT proceedings version it was described that the result contradicts 
the bound in but it was the confirmation error of the author because of the 
difference of notations between this paper and m See Remark |4| for detail. 




II. Preliminary 


We consider a memoryless channel with input alphabet X 
and output alphabet y. The output distribution for input x G X 
is denoted by W{-\x). Let X G X ht s. random variable with 
distribution Px and Y G y ht following W{-\X) given X. 
We define Py as the marginal distribution of Y . We assume 
that W{-\x) is absolutely continuous with respect to Py for 
any x with density 


v{x,y) 


dW{-\x) 

dPy 


iy) ■ 


We also assume that the mutual information is finite, that is, 

I{X;Y) =Exy[\ogiy{X,Y)] < ^. 


Let X' be a random variable with the same dis¬ 
tribution as X and independent of {X^Y) and define 
r{x,y,x') = logi'{x',y)/iy{x,y). Since v{X,Y) > 0 

holds almost surely we have r{X,Y,X') G M = 
[—c»,c») is well-defined almost surely. {X,Y,X') = 

{{Xi,--- ,Xn), (Li,--- ,Yn), {X[,--- denotes n in¬ 

dependent copies of {X^Y,X'). We define r{X ,Y, X') = 


We consider the error probability of a random code such 
that each element of codewords (Xi, • • • ,Xm) G X'^^^ is 
generated independently from distribution Px ■ The coding rate 
of this code is given by ii = (log M)/n. We use the maximum 
likelihood decoding with ties broken uniformly at random. 


A. Error Exponent 

Define a random variable Z{X) on the space of functions 
R R by 


Z{X) = logEjc' 

and its derivatives by 


^Xr{X,Y,X') 




^\r(X,Y,X') 


which we sometimes write by Z'{X), Z”{X),---- Here Ex' 
denotes the expectation over X' for given {X, Y). We defin^l 


Z{X + iO = logEx' 


^a(A -f i^ = log 


Ex' 


,(A+iC)r(X.Y.X') 

„(A+iOr(A:.Y,X') 


where A, ^ G R and i is the imaginary unit. Here we always 
consider the case A > 0 and define = 0. We define 


and we write the optimal solution of la, A) as (p, rj) = 
(p, 1/(1-f p)). We write logE[e“^*'^/^^“''“^^] = A(a). 

In the strict sense the random coding error exponent 
represents the supremum of O over Px but for notational 
simplicity we fix Px and omit its dependence. See Theorem 
2] for a condition that there exists Px which attains this 
supremum. 

Let Pp be the probability measure such that dPp/dP = 
eP^di)-Yp) _ We write the expectation under Pp by Ep and 
define 


p, = Ep[Z(*)(p)] = 

CTy = Ep[(Z(*)( 77 ) - pi){Z^^\r]) - pj)] 



From derivatives of aR X logE[e“'^*^^^] in a and A we have 


aiogE[e“^(’?)] 

da 

51ogE[eP^(^)] 

5A 


r 

= -R 

= ho < 

< -R 

OL—p y 

= Ot^Xi 

= 0. 

A=77 



if i? > iicrit, 

otherwise, 


( 2 ) 

(3) 


where i?crit is the critical rate, that is, the largest R such that 
the optimal solution of ([T]) is p = 1. We assume that p 2 > 0, 
or equivalently, Px[|Q(L) \ {0}| > 1] > 0 where Q{y) is 
the support of v{X\y). This corresponds to the non-singular 
assumption in ifTOllfTSll for the finite alphabet. 


To avoid somewhat technical argument on the continuity 
and integrability we also assume that there exists a,bo > 0 
and a neighborhood 5 of A = p such that for any 0 < 6i < 
62 < Stt/Ii < c» 

supEp[e“l^' * = 1,2,3, 

AGS 

sup < 00 , 

AGS. 5 G[-bo.bo] 

sup < 00 . (4) 

AGS, 5 G[bi.f) 2 ] 

where h> 0 is given later. Note that these conditions trivially 
hold if the input and output alphabets are finite. 


B. Lattice and Nonlattice Distributions 


Z^{X) = logEx' 


^\r(Xi,Yi,X') 


Z(A) = -^Z,(A). 


2=1 


and 


^a,i, -^a, “■■'j ^ are defined in the same way. 

The random coding error exponent for 0 < R < I{X;Y) 
is denoted by 

EJR) = - inf logE[e“^(^)]} 

(a.A)G[ 0 . 1 ]x[ 0 ,oo) 

= - min {ai?-flog E[e“^(i/(i+“»]}, (1) 

aG( 0 ,l] 


^We omit the discussion on the multi-valuedness of log 2 :. The discussion 
involving logarithm of a complex number in this paper arises by following 
□a Sect. XVI.2] and refer this to see that no problem occurs. 


In the asymptotic expansion with an order higher than the 
central-limit theorem, it is necessary to consider cases that 
the distribution is lattice or nonlattice separately. Here we call 
that a random variable V G R™ has a lattice distribution if 
V G {a + '^^ibihi : {bi} G Z™} almost surely for some 
a G R™ and linearly independent vectors G R™^™. 

For the case m = 1 we call the largest hi satisfying the above 
condition the span of the lattice. 

On the other hand, we call that V G R™ has a strongly 
nonlattice distribution if |E[e‘^^X>]| < i for all ^ G R"* \ {0}, 
where (•, •) denotes the inner product. Note that a one dimen¬ 
sional random variable V G R is lattice or strongly nonlattice 
but, in general, there exists a random variable which is not 
lattice and not strongly nonlattice. 





















As given above, a lattice distribution is defined for a 
random variable V G R™ in standard references such as m. 
In this paper we call that the distribution of V G R is lattice 
if the conditional distribution of V given V > —oo is lattice 
and nonlattice otherwise. It is easy to see that no contradiction 
occurs under this definition. 

We consider the following condition regarding lattice and 
nonlattice distributions. 


lattice for v, there exists no > 0 such that for all n> hq 
^niZiri)+R-iZ'{v)f/2{^L2-S2))' 


(1 - e)E 


9h{il- e)- 


< Pnci.n) 

< (l + e)E 


(1 + e) 


riy/2T:n^2 
^n{Z{r,)+R-{Z’ (vi)f /2 {^i.2+S2)) 


rj^/hrnfi^ 


Definition 1. We call that the log-likelihood ratio v satisfies 
the lattice condition with span h > 0 if the conditional 
distribution of logi/{X,Y) given Y is lattice with span hmy 
almost surely where my G N may depend on Y and h is the 
largest value satisfying this condition. 


For notational simplicity we define the span of the lattice 
for n to be h = 0 if n does not satisfy the lattice condition. 
Other than the classification of n, we also discuss cases that 
{Z{r]),Z'{i])) is strongly nonlattice or not separately. 

Note that a one-dimentional random variable E G R 
with support supp(E) is always lattice if |supp(E)| < 2, 
and is strongly nonlattice except for some special cases if 
|supp(E)| > 3. Similarly, a two-dimensional random variable 
E G R^ is always not strongly nonlattice if |supp(E)| < 3, 
and is strongly nonlattice except for some special cases if 
|supp(E)| > 4. Based on this observation we see that most 
channels with input and output alphabet sizes larger than 3 are 
strongly nonlattice. Another example of each class of channels 
(excluding those with specially chosen parameters) are given 
in Table. 12 

Remark 1. The above conditions are different from the 
condition considered in IfTOll as a classification of lattice and 
nonlattice cases. This difference arises from two reasons. First, 
we consider Z'{'q) in addition to Z{r]) to derive an accurate 
bound. Second, the proof of IfTOl Lemma 1] does not use the 
correct span when applying the result ifTSl Sect. VII. 1, Thm.2]. 


III. Main Result 


Define 


gh{u) = 1 - 


hrju 


for h >0. Here we define (e“ — l)/x = (1 — e~^)/x = 1 for 
T = 0 and therefore goiu) = hm/ij,o giu) = 1 — e““. We give 
some properties on gh in Appendix lAl Now we can represent 
the random coding error probability as follows. 

Theorem 1. Fix any 0 < R < I{X;Y) and e > 0, and let 
S 2 > 0 be sufficiently small. Then, for the span h > 0 of the 


By this theorem we can reduce the evaluation of error 
probability into that of an expectation over two-dimensional 
random variable (Z(p), Z'(p)), although this expectation is 
still difficult to compute. If {Z{g), Z'{g)) is strongly nonlattice 
then we can derive the following bound which gives an explicit 
representation for the asymptotic behavior of Prc- 

Theorem 2. Fix 0 < R < I{X;Y) and assume that 
(Z(g),Z'(g)) has a strongly nonlattice distribution. Then 


Prc( n) 




r]i’{2'jrn)C+p)/2^ (Ai2 0-oo-l-p|Soi |) 

'i(l+o(l)) j.-nEr.(R) 

2{eVh — l).f 2-n-n{fj.2+tTii) ’ 

h(l-|-o(l)) ^-nE,.(R) 

(en'i_l).^2irn(/22-l-o’ii) ’ 


P ^ Pcrit; 

P — Pcrit; 

P ^ Pcrit; 

(5) 


where 


/ OO 

-OO 

r(l — p) / hrj — 1 


Xti - 1 


for the gamma function F. 


We prove Theorems [T] and |2] in Sections m and m 
respectively. From this theorem we see that at least for the 
strongly nonlattice case the error probability of the random 
coding is 


PRc{n) 


P > Pcrit 


The RHS of (|6]l for R > Pcrit is the same expression as 
the upper bounds in Eoiini but our bound is tighter in its 
coefficient and is also assured to be the lower bound. 


It may be possible to derive a similar bound as Theorem 
12] for the case that {Z(rj), Z'(rj)) is not strongly nonlattice 
by replacement of integrals with summations, but for this case 
the author was not able to find an expression of the asymptotic 
expansion straightforwardly applicable to our problem and this 
remains as a future work. 

Remark 2. We can show in the same way as Theorem |2] that 
the random coding union bound is obtained by replacement of 


TABLE I. Classification OF Nonsingular Channels. 



(Z(v), 

not strongly nonlattice 

Zfr,)) 

Strongly nonlattice 

1 ,1 ,1 , lattice 

BSC 

asymmetric BEC 

. nonlattice 

ternary symmetnc channels 

binary asymmetnc channels 



























ipp^h with 


hrje^ 


=hr, -i'- 


, 1 > dw 


1 1 
1- p p 


hp 


Qhri _ I 


On the other hand, the terms |pSoi| and an in the square 
roots of 0 are the characteristic parts of the analysis of this 
paper obtained by the optimization of parameter A depending 
on {X, Y). Thus, the optimization of A is necessary to derive 
a tight coefficient whether we evaluate the error probability 
itself or the union bound. 


Remark 3. The results in this paper assume a fixed coding 
rate R and are weaker in this sense than the result by Scarlett 
et al. ITOl where they assure an upper bound for varying rate 
by leaving an integral (or a summation) to a form such that the 
integrant depends on n. It may be possible to extend Theorem 
[T] for varying rate since the most part of the proof deals 
with R and the error probability of each codeword separately. 
However, the proof of Theorem |2] heavily depends on fixed 
R and it is also an important problem to derive an easily 
computable bound for varying rate. 

Remark 4. In ||8l it is shown for discrete nonlattic^l channels 
with R < i?crit that 


PRc(n) = 


where 


, logE[e^('^^] 

^2 = ■ 


2Ey(‘*^o(y)w2(t/) - a;i(2/)2) 


for 


^7n{y) = ^Px(x)(logTE(2/|x))™y/H%ii). 


(7) 


( 8 ) 


The author misunderstood that p '2 = p ,2 in the ISIT version 
and described that Theorem |2] contradicts (|7]). The correct 
calculation show that p 2 ^ M 2 and 


M2 = CTii 


Ey (wo(m)w 2(?/) - Wl(j/)2) 

E^) 


for (p, p) = (1, 1/2). Therefore no contradiction occurs 
between this paper and IHl. 


IV. First Asymptotic Expansion 

In this section we give a sketch of the proof of Theorem 
[U We prove Theorem [T] separately depending on whether v 
satisfies the lattice condition or not. The proofs are different 
to each other in some places for two reasons. First, we cannot 
ignore the case that a codeword has the same likelihood as 
that of the sent codeword under the lattice condition whereas 
such a case is almost negligible in the nonlattice case. Second, 
especially in the case of infinite alphabet we have to use the 

‘‘There is a calculation enor for the lattice case in [8] with a redundant 
factor ^/tt. 


asymptotic expansion with a careful attention to components 
implicitly assumed to be fixed and the derivation of asymptotic 
expansion varies in some places between the lattice and 
nonlattice cases regarding this aspect. 

Here we give a proof of Theorem [T] for the case that v 
satisfies the lattice condition with span h > 0. The proof for 
the nonlattice case is easier than the lattice case in most places 
because ties of likelihoods can be almost ignored as described 
above. See Appendix |D] for the difference of the proof in the 
nonlattice case. 

Now define 


Poix,y) = Px'[rix,y,X') = 0] 

P+{x,y) = Px'[r{x,y,X') > 0] = Px'[r{x,y, X') > h]. 

(9) 


The last equation of ® holds since r{x, y, x') = log v{x', y) — 
logi/{x,y) and the offset of the lattice of \ogi/{x',y) equals 
to that of log v{x, y) given y. Under the maximum likelihood 
decoding, the average error probability Prc is expressed as 

PKG=^XY[qM{p+{X,Y),p^{X,Y))] for 


9m(f+,Fo) = 1 - (1 -F+) 

M-1 

+ XI Mo(l -F+ -Fo) 


M-1 


M 


i 



( 10 ) 


Here the first term corresponds to the probability that the like¬ 
lihood of some codeword exceeds that of the sent codeword, 
and each component of the second term corresponds to the 
probability that i codewords have the same likelihood as the 
sent codeword and the others do not exceed this likelihood. 


One of the most basic bound for this quantity is to use a 
union bound given by 


qM{p+,Po) < min{l,(M- l){p+ +po)}- 

A lower can also be found in, e.g., Uhl Chap. 23]. For 
evaluation of the error probability with a vanishing relative 
error the following lemma is useful. 

Lemma 1. It holds for any c € (0,1/2) that 


lim 


sup 


<?m(p+,Po) 


(p+,po)e(0,l/3]^:p+<M‘=po 1 - e (l-« 

Mpo 

= Mm inf - 

M-s-oo (p+,Po)e(0,l/3]2:p+<M‘=po 1 5_!ll) 


= 1 . 


Mpo 


We prove this lemma in Appendix |E] We see from this 
theorem that the error probability can be approximated by 

^-Mp+{X,Y)(^l _ g-Mpo(X.Y)) 

^ Mpo{X,Y) 

for (AC,1U) satisfying some regularity condition. 

Next we consider the evaluation of pq{X,Y) and 
p+{X, Y). We use Lemma|2]in the following as a fundamental 
tool of the proof. Let Ui, • • • , U„ € M be (possibly not 
identically distributed) independent lattice random variables 



















such that the greatest common divisor of their span^ is h. 
Define 

n 

= logE[e^^*], Av(A) = ^ Ay. (A). 

i=l 

Then its large deviation probability is evaluated as follows. 

Lemma 2 . Fix x > Pr[(^i — x)/h G 

Z] = 1 and define A* > 0 ai the solution of A'^(A*) = 
X. Let e, 72,6o 12, S2, S4 > 0 and 1.3,13 G ^ be arbi¬ 
trary. Then there exists hi = 6i(&0j1.2)S2j 13 5 S3,l4)j''T'0 = 
no(e, 60172,12;^2,13) 13,14) > 0 such that 


PrEr=i^* = 


y/nrKfffx*) 

PrELi Vi>x + h] 


- 1 


(e'*A*-l) 727 )A" (A* 
/10/c/ /or aW n > no satisfying 
d’"Ay,(A) 


-1 


< e. 


< e. 


ns^ 


E 


dA’^ 


^E 

a 4 Ay(A*+ie) 


* = 2 , 3 , 


A=A* 


5^4 


< ns 4 , V|^| < bo 


E (^°S - logE[e^*^']j < -7472, 

i=l 

G [- 7 r//i, 7 r//i] \ [-61, &i] . 


The proof of this lemma is largely the same as that of ini 
Thm. 3 . 7 . 4 ] for the i.i.d. case and given in Appendix iBl 

Let &o, ^ 1 ,( 52 , <53,71,72,14 > 0 satisfy 82 < min{^ 2 / 2 , 
^2 a/ 77 / 12 }. To apply Lemma | 2 ] we consider the following 
sets Arm Tn = 2 , 3 , B,C to formulate regularity conditions. 


the likelihood of each codeword given the sent codeword X 
and the received sequence Y as follows. 

Lemma 3 . Let e > 0 be arbitrary and ( 5 i > 0 in the definition 
of S be sufficiently small with respect to 71. Then, there exists 
ni > 0 such that under the event S it holds for all n > ni 
that. 


f^^n{Z{rt)-Z'(ri)^/2(ii2-S2)) 


{l-e)<po{X,Y) 


yEm(/E+E) 

f^^n{Z{r])-Z'(ri)^/2 (i12-\-S2)) 


< 


(1 + e) , 


V^ 27 rn(/i 2 - 82) 
h n{Z{r))-Z'{r))'^/2{ii2-S2)) 

{l-e)<p+{X,Y) 


(e**(’ 7 + 7 i) — l)^2Trn{p2 + ^2) 

^^n{Z(r])-Z'{rif /2{(i2+S2)) 

< 


(Qh{r) 71) _ l)^2Tm{p2 — 82) 


(l + e). 


Proof: Note that \Z'{Tf)\ < ( 5 i and Z''{\) > /i2/2 for all 
A G [77 — 71,7 + 71] from G Am and @. From the 

convexity of Z{X) in A, if we set i 5 i < 717x2/2 then Z{X) is 
minimized at a point in [p — 71,7 + 71] with 


z{v) 


(z'{v)r 

2(7*2— 82) 


< nunZ(A) < Zijf) 


2(7*2 + 1^2) 


Thus the lemma follows from Lemma 


El 


Next we define 

S-), 


g''->{X,Y) = {l-e/2)gu 


g\^\X,Y) = {l + e/2)gu 


gn(Z( 7 ,)+fi-(Z'(r)))V 2 (M 2 - 52 )) 
pn{Z(r,)+R-(Z' {r))f /2(p.2+S2)) ' 




Gi^^=E[pi^)(X,r)],sG {-,+}, 


where 


-Am = {/l G Cl : VA, |/m(A) — 7 im| < ^2} , 
s = {/2 G C2 : VA,e ^ [-61,61], /2(A,0 < -72} , 

C = 1/2 G C2 : VA, f G [—&o, ^0], /2(A, f) < I4} , 

where Ci and C2 are the spaces of continuous functions \q — 
71,7+71] —>■ K. and [77—71,7+71] x [—7r//i, tt/Zi] —^ R, respec¬ 
tively, and 61 is a constant determined from 60, S2,12, S3,13,14 
with Lemma | 2 ] 

We define the event S as 


5 = {\Z^^\il)\ < < 5 i} U {Z( 2 )(A) g AI2} U {Z( 3 )(A) g AI3} 
U{Za(A + iO-^a(A)GS} 




i 7 (eM> 7 + 7 i)_i)^ 2 ^(^^+ 62 ) 

^ (e'*’*-l)(l-e/2) 

(+) ^ 77(e^fa-T'A - 1)iJ2tt{p2 - 82) 

{eA - 1)(1 -p e/2) 

Then the error probability can be evaluated as follows. 

Lemma 4 . Fix the coding rate R and assume that the same 
condition as Lemma\^holds. Then, for all sufficiently large n, 

g[-\x,Y) < qM{p+{X,Y),po{X,Y)) < g^y^\x,Y). 

This lemma is straightforward from Lemmas [I]and[ 3 ] We 
use the following lemma to evaluate the contribution of the 
case S"^. 


where we regard Z{X + i,^) as function {X,f,) 1—>■ Z{X -f i^). 
Under this condition we can bound the excess probability of 


^ The greatest common divisor for a set {hi, / 12 , ■ ■ ■}, hi > 0, is defined 
as h > 0 if h is the maximum number such that hi/h S N for all i and 
defined as 0 if such h does not exist. 


Lemma 5 . Let g{X,Y) = Then 

qM{p+{X, Y),po{X, Y)) < ~g{X, Y ), 

s\:\x,Y)A-f^giX.Y). 


( 11 ) 

( 12 ) 





































Furthermore, for sufficiently large S4 and sufficiently small 
7i <C min{(52, <53} and 72 <C we have 

IS -logExv[l[ 5 l 5 (^,>^)] 

n—fca TL 


We prove this lemma in Appendix O The proof is obtained 
by Cramer’s theorem for general topological vector spaces uni 
Theorem 6 . 1 . 3 ] with the fact that Ci and C2 are separable 
Banach spaces under the max norm. 

Proof of Theorem | 7 } From Lemma | 4 l it holds for ( 5 i <C 
7i <C min{(52, <53}, 72 <C and sufficiently large n that 

Pkc = Exy [1 [5] qM{p+{X, Y),po{X, y))] 

+ Ex>'[l [51 qMip+{X, Y),po{X, y))] 

< + Ex>'[l [51 qM{p+{X, Y),po{X, y))]. 

Thus we obtain from Lemma [ 5 ] that 

Pkc . PnG-Gi+^ ^ Exy [1 [51y)] 
^(+) ~ 


Similarly we have 

PKC>PxY[HS]gi-\x,Y)] 

= Gi-^-mSl9t\x,Y)] 

and therefore 

Pkc ^^_l + hp/2g{X,Y) 


G 


(-) - 


(c( 


G 


(-) 


and we see from Lemma [ 5 ] and Lemma [6] below that 
g{X,Y) _ 

„(s) - ^ { + >“} 


and we obtain Theorem [T| 


V. Second Asymptotic Expansion 

To prove Theorem| 2 ]it is necessary to evaluate the expecta¬ 
tion gY^ = E[(7^'^^ (X, y)]. This expectation can be bounded 
by Lemma [6] below and we give a sketch of its proof in this 
section. 


around z G as Bs{z) = {z' ; ||z —z'|| < 5 }. The oscillation 
w/ of / is dehned as 

ujf{S) = sup f{z') - inf /(z'), 5 C 

z'es 2 es 

a;/(( 5 ; < 1 >e) = sup / u}f{Bs{z))(j)^{z + a)dz . 
aGR2 J 

We use the following proposition on the asymptotic expan¬ 
sion for the proof of Lemma [ 6 ] 

Proposition 1 ([HI Theorem 20 . 8 ]). Let yi,V2,"‘ C 
be i.i.d. strongly nonlattice random variables with mean zero 
and covariance matrix E. Then, there exists a three-degree 
polynomial h{z) = h(zi, Z2) such that for any function f(z) 

J f{z) ( 1 -^) Mz)<^z-p[fiy)] 

< W/(R^)( 5 „ -f UJf{6n\ $1;) , 

where Sn satisfies lim„_>oo y/n 5 n — 0 and does not depend on 

/■ 


To apply this proposition we define 

Q^Jnzx-z'^ I'lcx 


fniz) = e 


_ p-y/npzi 


9h 


C2s/n 


The oscillations w/„(R.^) and ujf^{Sn',d>) of /„ are equal to 
those of 


Q-Vnp{zi-^A) I £. 


,/n{zi — y/nA) — z'^/2ci) 


C2s/n 


from their definitions. 

We can bound the oscillation of /„ as follows. 
Lemma 7 . It holds that 

Furthermore, if p < 1 then 


( 13 ) 

( 14 ) 

( 15 ) 


We prove this lemma in Appendix |F| By this lemma we 
can apply Proposition [T] to the proof of Lemma [6] which we 
give in Appendix IgI 


Lemma 6. Fix the coding rate 0 < i? < I{X]Y) assume 
that {Z(r]), Z'{p)) is strongly nonlattice. Then, for any fixed 
Cl, C2 > 0 and sufficiently large n. 


E 


pniZ{p)-VR-iZ (r,) f /2ci) 


9h 


C2\fn 

^-nE. 

.y/27m(croo-l-p|Soi l/ci) 


■(«)(1 + 0(1)), R>Rcrit, 


= 


Mc^)- e-»^-(^)(l + o(l)), 


2(e'‘P-l).y/l+CTii/ci 
-_ e-nEr{R)M ^ 


R — Rcrit, 
R ^ 5crit- 


Let and be the cumulative distribution function 
and the density of a normal distribution with mean zero and 
covariance E, respectively. We dehne the ( 5 -ball Bs{z) G 


VI. Conclusion 

We derived a bound of random coding error probability, 
the relative gap of which converges to zero as the block length 
increases. The bound applies to any nonsingular memoryless 
channel such that {Z{g),Z'{g)) is strongly nonlattice. The 
main difference from other analyses is that we optimize the 
parameter A around g depending on the sent and the received 
sequences (X, y). A future work is to extend the bound to 
the case that {Z{g),Z'{g)) is not strongly nonlattice, that is, 
{Z{g),Z'{g)) is distributed on a set of lattice points or on a 
set of parallel lines with an equal interval. It may be possible 
to derive an expression of asymptotic expansion applicable to 
our problem by following the discussion in |[T 4 l Chap. 5 ]. 

®The explicit representation of h(z) is given in the original reference 1141 
but we do not use it in this paper. 
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Appendix 


A. Properties of Function 

Lemma 8. For Ch = ^ + hr] it holds that 

gh{u) < min{l, Chu} 

< ChUP 


and 


0 < 


dghju) 

du 


< (it + hg)e “ 


< Ch ■ 


(16) 

(17) 

(18) 
(19) 


< min{l, Chu} 


and (fTTl) is straightforward from 0 < p < 1. We obtain (fTSl) 
by 


dghju ) 

du 


= e 


s'*’7-1 


< e 


-u f Iwu 

V 

= (it + hr])e~ 

and ( [19] ) follows from 


1 _ e-hr,u ^ 

QhT] _ I hgu^ 

1 — (1 — hrju){l + hgu) 
hrju^ 

ite““ < 1 for any it > 0 . 


B. Proof of Lemma |2] 

The proof of Lemma |2] is almost the same as ifTTl 
Thm. 3.7.4] where the same result is proved for the i.i.d. case 
based on the asymptotic expansion for i.i.d. random variables. 

In iflTl Thm. 2, Sect. XVI], the asymptotic expansion 
for one-dimensional lattice random variables is derived for 
i.i.d. cases. It is discussed in lIT^ Sect. XVI. 6 . 6 ] that the result 
is easily extended to non-i.i.d. cases by slightly modifying the 
proof with some examples depending on regularity conditions. 
In our setting the following expression is convenient as an 
asymptotic expansion for non-i.i.d. lattice random variables. 


Proposition 2. Let £, 52 ,^ 2 ,^, 53 , 54 , 60,72 > 0 be arbitrary 
and Vi, - ■ ■ ,Vn GM. be independent lattice random variables 
such that the greatest common divisor of their spans is h, 
E[V)] = 0 and Vv\Vi/h G Z] = 1. Then there exists bi = 
6i(s2,S2,S3,S3,S4,6o),'I10 = ^-0 (c, ^2 , *2, S 3 , S 3 , S 4 , 6o, 72) 

satisfying the following: it holds for all n > riQ satisfying 


n 

ns 2 < ^ < ns 2 , 

n 

ns^ < ns3 , 

i=l 


^log|E[e*«''*]| < - 7172 , e [-7r//i,7r//i] \ [- 61 , 61 ], 


E 


logE[e'«^-] 


< 7154, 


VjCI < 60 


that 


sup 

Pr 


V 


L \/7lS2 J 


-‘^{v) -- v^)(j){v) 




where Sm = n~^ Efci ~ d-lv/d] — v — d/2, $ 

and 4> are the cumulative distribution function and the density 
of the standard normal distribution. 






















Proof of Lemma^ Let P' be the probability distribution 
of {Vi} such that dP'/dP = ) xhen 


P 


Y.v> 


L 2=1 

Here note that 


= e 


—Av(A*) 


Ep' 


jA* Y,i=i Vif 




and 




i:S5^=av(a-)=. 


from the definition of A*. Therefore 


P 


E —" 

.i=l 

g-Av(A*)g 


gA* T,7=iVii 


^(E,-Ep,[14]) >0 




Here the variance of Vi under P' are represented by 


and similarly 

n n 

y]log|Ep,[e'«^^]|=y]log 


dA 2 




A=A* 


( 20 ) 


eA(A*) 

y](log|E[e(^*+'«)^-]|-logE[e^*'"-]) . 


i=l 


Thus we can apply Prop.|2] to the evaluation of (l20l l and we 
obtain Lemma|2]by the same argument as iflTl Thm. 3.7.4] for 
the i.i.d. case. ■ 


C. Proof of Lemma |5] 

In this appendix we show Lemma |5] Note that (fTTT i is ob¬ 
tained easily by the standard discussion used in the derivation 
of random coding exponent and (fl^ also easily follows from 

dnj. 

We prove Lemma |5] based on Cramer’s theorem in iflTl 
for general vector spaces, which is written for our setting as 
followfl 

Proposition 3 (Cramer’s theorem IflTl Theorem 6.1.3]). Let /i 
denote the distribution of i.i.d. random variables Vi, V 2 ,' ’ ‘ on 
a topological real vector space V. Assume that V is a separable 
Banach space. Then, for any compact set 5 C V, 


where V* is the topological dual of V. 


We use the following lemma derived from this proposition. 

Lemma 9. Let V be the space of continuous functions 
on a compact set A into K. and Vi,--- ,Vn be i.i.d. ran¬ 
dom variables on V such that E[E(s)] = v{s) and 
sup,g 5 E[e“°l^(*)l] < 00 for some ao > 0. Then, for any 
compact set .4' C and e > 0, the empirical mean 
V = n~^ Sr=i ^ satisfies 


lim — log Pr 

n—foo Tl 


sup |E(s) — t^(s)| > e 


< 0 . 


Proof: Let V 9 / be equipped with the max norm 

ll/ll = max|/(s)| 
s^S 


and V* be its topological dual, that is, the family of (signed) 
finite Borel measures on S. Then, we obtain from Cramer’s 
theorem for 5 = {/ G V : sup 5 g_ 4 / |/(s) — u(s)| > e} that 


lim — log Pr 

n—foo Tl 


sup |P(s) — 'u(s)| > e 
-sG.4' 

<-mf sup{(/, 6 »)-logE[e<^i’®>]}. 
/eSggv* 


By considering a set of point mass measures : a G 

s G A} as a subset of 17*, we obtain 

inf sup{(/, 0 )-logE[e<^-®>]} 

/GSggv* 


> 


/S'® sG.4 

Here note that 


inf sup sup |a/(s) — logE[e“'^^®^]| . 

feS sC A' r. f J 


0 <^l«gE 




< 


< 


< 


E[P(s) 2 e“^('*)] 
E[e“^(®)] 
E[P(s) 2 e“^(®)] 
E[1 -b aP(s)] 
E[E(s) 2 e“l^('*)l] 
l-|«|E[|P(s)|] 


for |a| < l/E[|P(s)|]. Since there exists /3 > 0 such that 
^ 2 ^ao\x \/2 ^ yj^gao|a:| _|_ 2 ) and |a;| < hold for all 

a; G K., 


92 

sup -^logE 

\a\<ao/2 OOi 


yV (s) 


< C 


for some c > 0. Therefore 


lim — log Pr 

n—^oc Tl 




2=1 


<-inf sup{(t;, 6 »)-logEfe^'^^’^^]}, 
v^S ggv* 


^Cramer’s theorem in E) is described for a more general setting such that 
V is sufficient to be a metric space under some regularity conditions. When 
we consider Banach spaces some of these conditions are satisfied and the 
theorem can be represented in the form of this paper. 


inf sup{(/, 6 »)-logE[e<^i’®>]} 

/GSggv* 

> inf sup sup {a/(s) — aP(s) — ca 2 / 2 } 

f^S \a\<ao/2 


> inf sup {|a|e- 

4 |o:|<ao 


ca 2 / 2 } 


> 0 


and we obtain the lemma. 



































We can apply Lemma | 9 ] to the proof of Lemma | 5 ] from the 
following lemma. 

Lemma 10. Let A > 0 and ^ € [—tt/Zi, 7r//i]\{0} be arbitrary. 
If V satisfy the lattice condition then 

Ep[Za(A + iO]-Ep[Za(A)] < 0 . 


D. Theorem \I\for Nonlattice Channels 

In this appendix we give a brief explanation for the proof 
of Theorem [T] in the case that h = 0, that is, ly does not 
satisfy the lattice condition. For this case we bound the error 
probability by 


Proof: Let Ex ',a be the conditional expectation on 
X' given {X^Y) under distribution Px'.\ such that 
dPx',x/APx' = e>'P^X,x')i^^fQ>^r{x,Y,x')\^ Then 


Ep[Z(A + iO]-Ep[Z(A)] 


= Ep 
= Ep 

= Ep 
= Ep 




log|Ex'.A[e‘«’'(^’EX')]| 

log IEx'.a| 
'log|Ex'.A[e'«'°s'^(^'’'")]| . 


YxY[qM{Pi/^{X,Y))] < Prc < PxYiqMiPoi^,y))] 

where 


Pc(®>y) = Px'[rix,y,X') > Q 

Similarly to Lemma [T] we have the following lemma. 
Lemma 11. It holds for any c € ( 0 , 1 / 2 ) that 

mijp) . „ mip) 

lim sup --^ = hm int -- tj 

M->-oOpg( 0 ,l/ 2 ] 1 ~ e P M->-ooP6(0.1/2] 1 — e P 


On the other hand, the definition of lattice condition in 
Def.[I] implies that P[|Ex'.A[e‘^= 1 ] < 1 holds 
for any ^ ^ {2m7r//i : m G Z}. 


Since P is absolutely continuous with respect to 
Pp we have Pp[|Ex'.A[e'^= 1 ] < 1 for 
^ity ^ ^ { 2 rmT/h : m G Z}. Thus we obtain 
Ep[log|Ex'.A[e'^‘°®''^^'’^^]|] < 0 by noting that E[E] < 0 
holds for any random variable E G K. such that V < 0 a.s. and 
Pr[E < 0 ] > 0 . ■ 


Proof of Lemma | 5 } First we have 
Exy[l [S^] 

_ Q'n.{Hp)+pR) 


< ( Pp[|Z(i)(??)| > 5i] +Pp[Z(2)(A) ^ A: 

A) ^ As] + L 

^ 4 -ZW(A + iO 


+ Pp[Z<-^\X) i Ala] + Pp[^a(A + iO - ^a(A) G B\ 

54 


Pn 


9 ^ 


G C 


( 21 ) 


Note that the moment generating functions of the absolute 
values of the empirical means in (ISTT l exist from the regularity 
conditions assumed in (|4li. It is straightforward from Cramer’s 
inequality that 

IS) -logPp[|ZW(7;)| >< 5 i] <0 

n^oo Ji 

since ¥AZ^^\rj)\ = 0 . It is also straightforward from Lemmas 
| 9 | and [l 0 | that the other four probabilities in (1211 1 are exponen¬ 
tially small for sufficiently small 71 with respect to (62,63) 
and 

72 = - ^ sup Ep[Za(A + i^ - ^a(A)] 

AG[?7—7i,p+7i] 

S4 = 2 sup Ep 

As [r;— 71 , 77 + 71 ] 

{e[—boAo] 


d^Z(X + i^ 
5^4 


The proof of this lemma is given in Appendix]^ We can 
obtain Theorem[T]for /i = 0 by replacing the exact asymptotics 
for non-i.i.d. lattice random variables with that for nonlattice 
random variables based on the asymptotic expansion for non¬ 
lattice random variables considered in ifT^ Thm. 1 , Sect. XVI]. 
More precisely we can show Theorem [T] by replacing Prop.| 2 | 
with the following proposition, which is also easily obtain 
from the discussion in lfT 2 l Sect. XVL6.6] for non-i.i.d. random 
variables. 

Proposition 4. Let e,S2j®2,S3,S3,S4,&0j72 > 0 ar¬ 
bitrary and Vi, ■ ■ ■ ,Vn G M be strongly nonlattice 
independent random variables such that E[E] = 0 
and Pr[E//i G Z] = 1 . Then there exists d = 
d(s2, 82,33,33,34, bo) < d = d(e, 3,2, 32, S3, S3, 34, bo) and 
n-o = S2j^2>^3!^3j (*0! 72) satisfying the following: 

it holds for all n > no satisfying 


that 


n 

ns2 < ns2 , 

n 

<'^V^ < ns3 , 


^log|E[e'^^’]| < -7172, 


E 

2=1 


logE[e'«E] 


de 


< ns4. 


V^G[d,d], 
V|CI < bo 


sup 

Pr 

rv” V- 1 

V 


L ^yns2 J 



(1 - v'^)(l)(v) 



E. Bounds on Error Probability for M Codewords 
In this appendix we prove Lemmas [T] and [TT] 




























Proof of Lemma [7} First we have 

M-l 


XI Po(l -Po -p+) 


M-i-1 


2=1 


M-l 


= (l-p+)^ ^-(1-P0-P+) 


M-l 


( 22 ) 


and 

M-l 


Orb 


2 = 1 
M 


M-2 


^Zpo(i-p.-pJ 


(1 -p+) - (1 -Po - P+) 

Mpo 


i + 1 
Af 


M 


- (1 -po -P+) 


M-l 


(23) 


Combining (l22l i and ( l2?t with ( fTOl i we obtain 

(1 - p+)^ - (1 - po - p+)^ 


and 


1 - 


9m(p+,Po) = 1 - 


qMip+,Po) 


Mpo 


g-Mp+(i_e-Mpo) 

Mpo 

^ Afpo - (1 - p+)^ - (1 - po - p+)^ 
Afpo - e-^P+ (1 - e-^Po) 

Afpo-(l-p+)^ 


= 1 - 


A/po - e-^P+ (1 - e-“Po) 


(1 _ p^)M (^1 - (l - - e-^P+ (1 - e-^^Po) 

~ Mpo - e-^P+{l - e-“Po) ■ 

Here note that log(l — x) > —x — 2x'^ for x < 1/2. Therefore 
for po,p+ < 1/3 we have 


(l-p+)“ 1- 1- 


Po 


1 -p+ 


MN 


/ Mpo 2Mp^ 

< g-Mp+ I X — e ^“’’+ 


< g-A^P+ ^2^ _ g-Mpo-2Mpop+-5Mp^^ 

< e-^P+ (1 - (1 - min{l,5AT(p^ +p+po)})e-^P“) , 
which implies 

I 1 <?m(p+,Po) 

hm sup <1- ztm - 77 — 

(p+,po)G(0,l/3]2:p+<M<=po | 1 - 2-tilz2-!2) 


Mpo 


-— minfl, 10Af^+^°Pn} 

< lim sup —- - -^—r . 

^^°“po6(0,l/3] -^Po - (1 - e P°) 


= lim sup 


1 min{l, lO(Mpo)^} 


M^oop^g(o 1/3] Afi '^'=Mpo-{l-e ^Po) 


Similarly, for po,p+ < 1/3 we have 


(l-p+)^ 1- 1- 


Po 


> Q-Mp+-2Mp^ / ^ _ g-T^ 


1 -p+ 

Mpo 


MN 


> Q-Mp+-2Mp\ _ g-Mpo^ 

> e"^^’+(l - min{l, 2Afp^}) (l - e~^P°) 


and 


Ito int <1- 

M^oo {P+^Po)&{0,l/3]'^:p+<M'=po | 1 +(l-e pq) 

^ Mpo 

-— minjl, 2Af^+^°pQ} 

> — lim sup —-—- 

M-i-oo (pi.,po)g(0,i/3]2.p^<Mi+<=po Mpo - (1 - e PO) 

= 0 , 

which concludes the proof. ■ 

Proof of Lemma m By letting t{x) = x ^ log(l — x) 
we have 


1 _ (1 _ p)^-l 1 — qP(^-'^)Pp) 


1 - g-pM 


1 - e-P^ 

p-pM /'pP(M+(M-l)t(p)) _ 


= 1 - 
= 1 - 


1 ) 


1 - e-P^ 

gP(M+(M-l)t(p)) _ 2 


gpM _ I 

By t{x) < —1, the second term is bounded from above as 

gP(M+(M-i)t(p)) _ 2 — 1 

- < 


gpM _ I 


< 


qPM _ 

eP- 1 


< 


pM 
e — 1 

~jr 


(24) 


and bounded from below as 

gP(M+(M-l)t(p)) _ ^ 


qPM _ 1 

p{M +{M- l)f(p)) 


> 


> 


gpM _ I 

Af(p + log(l-p)) pf(p) 


> - 


gpM _ I qpM _ X 

M(-2p2) 
gpM _ I 

2 (Afp)2 


(25) 


MeP^ -I 


> -f , (by ^ < 1 for X > o) (26) 

~M V e“-1“ J 

where we used log(l — p) > —p — 2p^ for p G [0,1/2] and 
t{x) < 0 in (|25 T i. We complete the proof by letting M ^ oo 


= 0 . 








































F. Evaluation of Oscillations 

In this appendix we prove Lemma |7] on the oscillations of 
function /„. We hrst show Lemmas and fOl below. 

Lemma 12. For any set S C 

^fJS) <Chic 2 )-Pn-P/^ sup 

Z 2 :zeS 


Proof: We can bound /„ as 


fn{z,,Z 2 ) = e-^P^^ 


9h 


^s/nz\—z\l 2 c\ 

C 2 \fn 


= {c. 2 sfn) 


-Pp-pzh'zci-p 


^by letting 


u '-ghiu) 


C2\/n 




<Ch{c 2 \/n) '’e (by (fTTIi) 


Thus we obtain the lemma since /„(z) >0. ■ 

Lemma 13. Let u > 0 and r G [—1/2,1/2] be arbitrary. Then 


\gh{(f + r)u) - gh{u)\ < Ch\r\u , (27) 

\gh{{.'^ + r)u) - gh{u)\ < Ch\r\. (28) 


Proof: Eq. (l27l l is straightforward from (fT9l l. We obtain 
(|28 T i from 

dg/t((l + ?-)») __ ^ Jtghiv) 
du 

< rt((l + r)M +/i77)e““ (by (fTsTi) 

< 6e“^ + hge~^ 

< Ch ■ 


By using these lemmas we can evaluate the oscillation of 
/„ within a ball as follows. 

Lemma 14. Assume \z 2 \ < Ci^/nj2. Then, for sufficiently 
large n, 

w/„ iBs„(z)) < , (29) 

C2 

(-B5„ (2)) < 4(1 + Ch)V^Sne-P^^^ . (30) 


Proof: First we obtain for z' satisfying || and 

sufficiently large n that 

1(4)^-^il< 14-^21(141+ k2|) 

< 14 - 22|(2|z2| + |Z2 - 41) 

^ I Cl \/u “t“ I 

< 2ci5„4n. (by lim„_>oo = 0) 

Let w = zi — z\llflc\^Jn) and w' = z'-^ — {z'f)^j 

Then 


\w — tuj < 14 — -^il + 
< 2(5„. 


14-(4)^ 

2civTi 


Therefore we obtain for sufficiently large n that 

qP^w' 


QP^/nw 

QPy/nz[ 


Qp,/nzi 


- 1 


- 1 


< 2{p^/n\w' — wj) < 2\/nS„ 


since lim„_>oo '/nSn = 0. Therefore by letting <5]^ = 2S„ 
and using dZTl i we obtain for sufficiently large n that 

Uz') < (1 + 5'Je-P^^^gn + 

y C2Vn J 


C2\/n j C2\/n 

C 2 \/n j C 2 y/n 

We obtain ( |29] | from these inequalities by 


fuiz')>il-S'Je-P^^^ L 


utfABsAz)) < 2S'„e-P^^^ 


9h 


= + 


< A 6 Le-P^^^ — 


y/nu 


— n 


C 2 \/n 


C2s/n j C2y/n 

(by (fT^ ) 


C 2 \/n 


Similarly we obtain from (1281) that 


/4^') > (1 - 


^y/nw 

C 2 y/n 

p^/nw 


9h 


C 2 \Jn 

From these inequalities we obtain dSOl l by 


+ c/i4 

- ChS' 


oofABsAz)) < 25'^e-P^^- 


9h 


py/nw \ 

+ 


C2\/n j 
< 2(1 + Ch)5'^e-P^^^. 


Ch 


Proof of Lemma [7} Let 6„ be such that 

^ ^i/2+i/4pjy2p _ 

First we have 

J 0 Jf{{z' : ||z' — 2 ;|| < S})(j)s{z + a)dz 
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First we have 


/ 2 c 4 il + Ch)V^Sne-P^^^(l)j:{z + a)dz G. Proof of Lemma^ 

' \z 2 \<Cl^/n/ 2 ,z-]_>bn 
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(by Lemmas [12] and [l4)) 
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(31) 


Here recall that lim„_>oo \/n5n = 0 and therefore the second 
term of (jSTj) is bounded as 
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/ i/nSne~^'^''^faiiizi + ai)dzi 

Jbr, 


1 

-= / 

y'zttctj Jb„ 


1 Sne-P^^^ 
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' ^n{Z{ 7 j) + R-{Z'{ri)f/2ci)' 
C 2 y/n 


Here recall that E,p[Z{g)] = p-o ^ —R YiplZ'irf)] = pi = 
0 from (|2]l. By letting A = — (i? + pq), we have A = 0 
for R ^ Relit and A ^ 0 for R -Rcrit- Normalizing Z{^ifj 
and Z'f]) as Z\ — i/n{Z{p) + i? + A) and Z 2 = i/nZ'(jf), 
respectively, we have 
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E 


gh 


C 2 \fn 


^ ^-nEPR) 


E„ 


Q-Vnp(Zi-i/nA)I ® 
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We obtain from Prop.[T] that 
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We obtain (O since the first term of OTI) is bounded as 
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J —OO 
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1 -p 
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For the case (i) p < 1,A = 0, this integral is evaluated 
as (O. Similarly for cases (ii) p = 1,A = 0 and (iii) p = 
1, A > 0, it is evaluated as ( l?4b and (1351 ). respectively, since 
Q-i/nwg^^^i/nw^ < Q-Vnw jjolds for any w and 




+ 0 ( 1 )) 

) = ihp _ I 


holds for w < —n 


(See the next two pages for Eqs. (l33t - (lL5T l. ) 

Now, combined with Lemma |7| it suffices to show that 
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By letting a = hg and b = a/(e“ — 1), we can evaluate this 
integral as 
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(i) p < 1, A = 0. 
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Combining dJTl) with (l38l) and ( |39] | we obtain (l36l) by 
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(ii) p = 1, A = 0. 
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where we used p = 1/(1 + p). 
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